Discrete All-positive Multilayer Perceptrons for Optical Implementation Discrete All-positive Multilayer Perceptrons for Optical Implementation
نویسندگان
چکیده
All-optical multilayer perceptrons diier in various ways from the ideal neural network model. Examples are the use of non-ideal activation functions which are truncated, asymmetric, and have a non-standard gain, restriction of the network parameters to non-negative values, and the limited accuracy of the weights. In this paper, a backpropagation-based learning rule is presented that compensates for these non-idealities and enables the implementation of all-optical multilayer perceptrons where learning occurs under control of a computer. The good performance of this learning rule, even when using a small number of weight levels, is illustrated by a series of computer simulations incorporating the non-idealities.
منابع مشابه
Published in the Proceedings of the Third Ieee International Conference on Electronics Circuits and Systems Icecs Rodos Greece October a Method for All Positive Optical Multilayer Perceptrons
The most promising approaches for optical neural networks are based on intensity encoding However a serious drawback of intensity encoding is the lack of negative values and optical subtraction which are essential for rendering neural networks useful To overcome the need for optical subtraction a novel training method is described here that is es pecially useful for optical multilayer neural ne...
متن کاملA Method for All - Positive Optical Multilayerperceptronsi
The most promising approaches for optical neural networks are based on intensity encoding. However, a serious drawback of intensity encoding is the lack of negative values and optical subtraction, which are essential for rendering neural networks useful. To overcome the need for optical subtraction, a novel training method is described here that is especially useful for optical multilayer neura...
متن کاملWeight Perturbation: An Optimal Architecture and Learning Technique for Analog VLSI Feedforward and Recurrent Multilayer Networks
Previous work on analog VLSI implementation of multilayer perceptrons with on-chip learning has mainly targeted the implementation of algorithms such as back-propagation. Although back-propagation is efficient, its implementation in analog VLSI requires excessive computational hardware. It is shown that using gradient descent with direct approximation of the gradient instead of back-propagation...
متن کاملRecognition of Handwritten Digits Using Multilayer Perceptrons
Neural networks are often used for pattern recognition. They prove to be a popular choice for OCR (Optical Character Recognition) systems, especially when dealing with the recognition of printed text. In this paper, multilayer perceptrons are used for the recognition of handwritten digits. The accuracy achieved proves that this application is a working prototype that can be further extended int...
متن کاملSteganalysis of embedding in difference of image pixel pairs by neural network
In this paper a steganalysis method is proposed for pixel value differencing method. This steganographic method, which has been immune against conventional attacks, performs the embedding in the difference of the values of pixel pairs. Therefore, the histogram of the differences of an embedded image is di_erent as compared with a cover image. A number of characteristics are identified in the di...
متن کامل